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ABSTRACT 

We  show  that  seven  point  correspondences  are  sufficient  to 
uniquely  determine  from  two  perspective  views  the  three-dimensional 
motion  parameters  (within  a  scale  factor  for  the  translations)  of  a 
rigid  object  with  curved  surfaces.  The  seven  points  should  not  be 
traversed  by  two  planes  with  one  plane  containing  the  origin,  nor 
by  a  cone  containing  the  origin.  A  set  of  "essential  parameters" 
are  introduced  which  uniquely  determine  the  motion  parameters  up  to 
a  scale  factor  for  the  translations,  and  can  be  estimated  by  solving 
a  set  of  linear  equations  which  are  derived  from  the  correspondences 
of  eight  image  points.  The  actual  motion  parameters  can  subsequently 
be  determined  by  computing  the  singular  value  decomposition  (SVD)  of  a 
3x3  matrix  containing  the  essential  parameters.  No  nonlinear  equations 
need  be  solved. 


*  xhe  authors  are  with  Coordinated  Science  Laboratory  and  Department  of 
Electrical  Engineering,  University  of  Illinois  at  Urbana-Champaign , 
Urbana ,  Illinois  61801. 
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I.  INTRODUCTION 

The  importance  of  motion  estimation  in  image  sequence  analysis  has 
long  been  recognized,  particularly  in  such  fields  as  image  coding,  tracking 
and  robotic  vision.  Methods  for  two-dimensional  motion  estimation  are  rela¬ 
tively  well  known  [11-18].  As  for  three-dimensional  motion  estimation  from 
two  image  frames,  [2-3,20]  show  that  when  the  object  surface  is  planar, 
there  exist  a  set  of  eight  pure  parameters  that  can  be  estimated  by  solving 
a  set  of  linear  equations.  The  equations  were  derived  using  the  Lie  Group 
theory  [2],  and  the  uniqueness  of  the  eight  pure  parameters  given  all  the 
image  point  correspondences  on  the  image  plane  is  established  either  using 
Lie  Group  Theory  [2]  or  using  elementary  Mathematics  [21].  In  [20],  it 
is  shown  that  only  four  image  point  correspondences  (no  three  points 
colinear)  are  sufficient  to  ensure  the  uniqueness  of  the  pure  parameters. 

[3]  shows  that  once  these  pure  parameters  are  estimated,  the  motion  para¬ 
meters  can  be  calculated  by  computing  the  SVD  of  a  3x3  matrix  A  consisting 
of  the  eight  pure  parameters,  and  the  number  of  solutions  is  either  one 
or  two  (usually  two)  depending  on  the  multiplicity  of  the  singular  values 
of  the  matrix  A.  [20]  shows  that  regardless  of  the  multiplicity  of  the 
singular  values,  the  motion  parameters  are  always  unique  given  three 
image  frames. 


For  the  case  when  the  object  surface  is  not  restriced  to  be  planar, 
existing  theorectical  analyses  and  estimation  schemes  were  unsatisfactory 
in  ifie  sense  that,  theorectically ,  it  was  not  known  precisely  how  many 
image  point  correspondences  are  needed  to  ensure  the  uniqueness  of  the  motion 
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parameters  (up  to  a  scale  factor  for  the  translation  parameters,  of  course), 
and  practically,  all  estimation  schemes  rely  on  the  solution  of  nonlinear 
equations  using  iterative  search  [4,10,19,23-25].  For  example,  it  was 
stated  in  [10]  that  "in  any  case,  the  general  method  was  not  really  practic¬ 
able,  nor  was  it  .designed  for  efficient  use."  [19]  ended  up  with  18  non¬ 
linear  equations,  and  [4]  5  nonlinear  equations.  The  results  stated  in  [23] 
on  the  minimum  number  of  image  correspondences  were  not  intended  to  be 
rigorous  or  exact  since  the  author  tried  simply  to  equate  the  numbers  of 
unknowns  and  equations .  Another  related  problem  is  the  stereo  imaging  prob¬ 
lem  in  photogramme try  and  computer  vision  without  assuming  the  relative  orien¬ 
tation  of  the  two  cameras  since  pictures  taken  at  two  time  instances  with  one 
camera  can  be  regarded  as  taken  with  two  cameras  at  one  instance.  After  the 
motion  parameters  are  computed,  the  surface  structure  of  the  object  can  be 
determined  by  computing  the  z  coordinates  up  to  a  scale  factor  using  Eqs .  (5a) 
or  (5b)  in  this  paper.  Despite  the  fact  that  much  work  has  been  done  in  this 
area  (e.g.,  [27,28]),  no  one  has  studied  the  problem  of  minimum  information 
required  to  ensure  unique  solutions,  nor  was  there  any  technique  deve¬ 
loped  other  than  solving  nonlinear  equations  iteratively  or  making 
severe  approximatons  to  the  unknowns.  Another  related  problem  is  the 
so  called  "Location  Determination  Problem"  as  described  in  [26],  where 
the  distances  between  the  observed  points  are  assumed  to  be  known  a  prior, 
which  of  course  creates  a  different  but  simpler  problem.  In  short,  the 
results  in  the  present  paper  should  be  of  interest  to  many  areas  of 
research . 


In  this  paper,  a  solution  to  the  problem  of  estimating  three- 
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dimensional  motion  of  a  rigid  body  from  two  image  frames  is  presented. 

Two  major  theorems,  one  lemma  and  six  corollaries  regarding  the  uniqueness 
and  estimation  of  motion  parameters  are  stated  and  proved.  First,  a  3x3 
matrix  E  containing  8  essential  parameters  are  introduced .  It  can  be 
factored  into  a  product  of  a  skew-sysmetric  matrix  containing  only  the 
translation  parameters,  and  an  orthonormal  matrix  containing  only  the 
rotation  parameters.  Theorem  I  states  that  given  the  E  matrix,  the  actual 
motion  parameters  are  unique  and  can  be  determined  simply  by  computing  the 
SVD  of  the  E  matrix.  The  E  matrix  can  be  estimated  by  solving  a  set  of 
linear  equations  given  8  image  point  correspondences.  Lemma  I  shows  that 
the  actual  motion  parameters  are  unique  if  and  only  if  a  certain  4x4  matrix 
C  is  skew-symmetric.  Theorem  II  shows  that  if  all  the  observed  points 
are  not  traversable  by  two  planes  with  one  plane  containing  the  origin,  nor 
by  a  cone  containing  the  origin,  then  the  matrix  C  has  to  be  skew— symmetri c - 
All  other  results  follow  from  these  two  theorems  and  the  lemma.  For 
example:  two  planar  patches  determine  the  motion  parameters  uniquely; 

4  points  on  a  plane  not  passing  through  the  origin  and  2  other  points 
not  on  this  plane  determine  the  motion  parameters  uniquely;  6  points  with 
4  on  one  plane,  4  on  another,  and  2  common  to  the  above  two  groups  of  4 
points  on  the  intersections  of  the  two  planes  can  insure  unique  solution; 

7  points  in  general  positions  are  sufficient  to  determine  the  motion 
parameters  uniquely;  etc.  Note  that  Theorem  II  only  gives  a  sufficient 
condition.  Although  7  or  more  points  in  general  positions  are  enough 
to  ensure  uniqueness,  6  or  even  5  points  are  usually  sufficient  from 
our  experience.  (One  should  be  cautious  not  to  take  solutions  that  yield 
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z's  that  are  positive  before  the  motion  and  negative  after  the  motion,  or 
vice  versa.)  However,  with  5,  6  or  7  points,  one  has  to  solve  nonlinear 
equations  with  iterative  search,  while  with  8  or  more  points,  the  simple 
method  using  SVD  as  stated  in  Theorem  I  can  be  used. 


II.  THE  E  MATRIX  AND  THE  EIGHT  ESSENTIAL  PARAMETERS. 


The  basic  geometry  of  the  problem  is  sketched  in  Fig.  1.  Consider 
a  particular  point  P  on  an  object.  Let 

(x,y,z)  =  object-space  coordinates  of  a  point  P  before  motion. 
(x',y',z')  =  object-space  coordinates  of  P  after  motion. 

(X,Y)  =  image-space  coordinates  of  P  before  motion. 

(X',Y')  =  image-space  coordinates  of  P  after  motion. 

The  mapping  (X,Y) — for  a  particular  point  is  called  an  image  point 
correspondence.  It  is  well  known  [22]  that  any  3-D  rigid  body  motion  is 
equivalent  to  a  rotation  by  an  angle  0  around  an  axis  through  the  origin 
with  directional  cosines  n1,n2,n3»  followed  by  a  translation  (Ax.^y.^z) 


x 

y 

z 


T 


(1) 


where  R  is  a  3  x  3  orthonormal  matrix  of  the  1st  kind  (i.e. 
n  1  +  (  1 -n  l^cos©  n 1n2 ( 1 -cose)-n3sin0 


det(R  )= 1 ) 


R 


n1-n2  ( 1  -cos&)+n3-sin0  n2  +  (  1  -n2*)cos© 

„  n  in  3  ( 1  -cos&)-n2sin©  n2-n3  ( 1  -cos0)+n  1sin0 


n  In  3  ( 1  -cos©)+n2sin© 
n2n3  ( 1  -cos0)-n  1-sin© 
n3+(  1  -n^)cos© 


(2) 
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Fig*  1  Basic  geometry  for  three- 
dimensional  mo cion 
estimation. 
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Although  the  elements  in  R,  namely  r 1 ,r2, . . . ,r9 >  are  nonlinear 
functions  of  the  rotation  parameters  n1,n2,n3  and  6,  throughout  this 
paper,  the  uniqueness  and  computation  of  R  rather  than  n1,n2,n3  and  0  are 
discussed.  The  reason  is  two  fold.  First,  as  will  be  seen  later,  to  each 
possible  R  in  (2),  there  corresponds  exactly  two  sets  of  rotation  parameters 
n1,n2,n3,6  with  one  set  the  negative  of  the  other.  Since  these  two  solutions 
are  physically  indistinguishable,  we  may  regard  the  relationship  between 
R  and  the  rotation  parameters  as  one  to  one.  The  second  reason  is  that  once 
R  is  determined,  the  task  of  computing  n1,n2,n3  and  8  is  trivial,  as  can 
be  seen  in  the  following: 

From  (2),  we  have 

R  =  3  +  K 


where 


S  = 


nl  +(1-n1  )cos0 
n 1n2 ( 1 -coser) 
n  1n3  ( 1  -cos0) 


n 1n2 (1 -cos©)  n1n3 (1 -cos0O 

n2*  +  (  1  — n2**  )cosB  n2n3  ( 1  -cos©) 

n2n30  -cos6)  n3*+( 1 -nS^Jcos© 


and 


is  symmetric 


0 

-n3 

+n2 

=  sin&* 

+n3 

0 

-nl 

is  skew-symmetric 

-n2 

+n1 

0 

Since  any  matrix  can  be  decomposed  uniquely  into  a  sum  of  a  symmetric  and 
a  skew-symmetric  matrix,  we  see  that  K  is  unique  given  R,  and  thus  n1,n2, 
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n3i&  are  fixed  up  a  possible  sign  change.  In  fact,  it  is  trvial  to  see 

that  r  _ 

0  r2-r4  r3-r7 

K  =  1/2  r4-r2  0  r8-r6 

r7-r3  r8-r7  0 

or  nl-sine  =  (r8-r6)/2,  n2-sin0  =  (r3-r7)/2,  n3*sin©  =  (r4-r2)/2, 
which  imply  sini0(n1l+n2%-n3a')  =  sin^e-l  =  d/4 
or  sine  =  ±d/2  ,  nl  =  _±(r3-rb)/d, 

n2  =  +(r3-r7)/d  ,  n3  =  +(r4-r2)/d  , 
where  d  =  (rS-rof  +(r3-r7f  +  (r4-r2)*  .  (If  d=0,then  0=0,  R=I,  and 
n1,n2,n3  can  be  anything  since  without  rotation,  the  axis  is  meaningless.) 


Since  sin0  alone  does  not  determine  0  uniquely,  we  still  need  cos©  to  fix  0, 
From  (2),  nl^  +  (1  -  nl^)cos0  =  rl 

2  rl  -(r8'r6)2  2  o 

co-e  •_  rl  -  nl  =  _ d  =  drl  -  (r8  -  r6)2 

l~nl  j  _  ^r8-r6^  d2  -  (r8-r6)2 


Therefore,  0,  nl,  n2  and  n3  can  be  easily  determined  from  R. 


Just  as  in  [2-7],  we  now  combine  (1)  with  the  following  equations 
relating  the  object  and  image  space  coordinates: 

X  =  x/z  X'  =  x'/z' 

(3) 

Y  =  y/z  Y '  =  y'/z' 

to  obtain 


(rl  X  +  r2  Y  +  r3)z  +  &x 

X'  =  - - — _ 

(r7  X  +  r8  Y  +  r9)z  +  Az 

( r4  X  +  r5  Y  +  rb  )z  +  £,y 

Y  '  =  - - - 

(r7  X  +  r3  Y  +  r9)z  +  Az 


(4a) 


(4b) 


where  the  focal  length  F  is  normalized  to  1  for  simplicity.  From  (4), 
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Ax  -  Az-X' 

z  =  -  (5a) 

X'(r7  X  +  r3  Y  +  r9  )  -  (rl  X  +  r2  Y  +  r3) 

Ay  -  Az*Y' 

and  z  =  -  (5b) 

Y'(r7  X  +  ro  Y  +  r9  )  -  (r4  X  +  r5  Y  +r6 ) 


Equating  ^ne  righ^  hand  sides  of  (5a)  and  (5b)  gives 


where 


AZ-  r4 

-  Ay-  r7 

A  z-  r5 

-  Ay-  r8 

Az  -r6 

>» 

<J 

1 

Ax-  r7 

-  Az-  r  1 

A  x  -  r8 

-  Az  -  r2 

Ax  •  r9 

-  Az-r3 

(7) 

ay- 

-  Ax-  r4 

Ay-r2 

-  AX-  r5 

Ay  ■  r3 

-  Ax-  r6 

el 

e2 

e3 

A 

e4 

e5 

ec 

(8) 

_  e7 

e8 

e9_ 

Note  that  the  equality  of  (6)  will  not  be  influenced  by  multiplying  E 
by  any  scalar.  Since  eacn  element  of  E  is  linear  in  Ax ,  AY  and  Az, 
vhis  simply  means  that  there  is  a  common  scale  factor  for  the  translation 
parameters  that  cannot  be  determined . (This  scale  factor  also  influences 
z  in  (5a)  and  (5b),  but  not  the  rotation  parameters,)  For  this  reason, 
we  can  always  set  e9  equal  to  some  fixed  number ,  say  1,  without  losing 
generality.  We  call  the  elements  in  E  "essential  parameters”  for 
reasons  that  will  be  seen  later. 

It  is  obvious  by  observing  (6)  that  the  3x3  matrix  E  contains  all 
the  information  one  can  possibly  obtain  given  any  number  of  image  point 
correspondences  (X,Y) — >(X',Y').  Thus  if  the  E  matrix  can  be  determined 
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uniquely  from  a  number  of  image  point  correspondences,  then  whether  the 
motion  parameters  are  unique  or  not  depends  soly  on  whether  the  motion 
paramefers  in  (7)  can  be  uniquely  determined  from  E.  This  is  one  reason  why 
we  call  the  elements  in  E  essential  parameters.  The  second  reason  is 
that  the  actual  3-D  motion  parameters  can  be  determined  uniquely  given  E, 
and  can  be  computed  simply  by  taking  the  SVD  of  E  without  having  to  solve 
any  nonlinear  equations  at  all.  The  third  reason  is  that  given  the  image 
correspondences  of  eight  object  points  in  general  positions,  ''he  E  matrix 
can  be  determined  uniquely  by  solving  8  linear  equations. 

Eefore  giving  Theorem  1  (which  concerns  the  uniqueness  and  the 
computation  of  motion  parameters  given  the  matrix  E),  let  us  first 
analyze  the  matrix  E.  From  (7),  we  have 


Az 

0 

1 

0 

Ay 

0 

0 

1 

E  = 

Ax 

0 

0 

1 

R  - 

Az 

1 

0 

0 

Ay 

- 

1 

0 

0 

Ax 

0 

1 

0 

■1 

Az 

Ay 

Ax 

R  - 

Az 

Ay 

Ax 

—  - 

_  — 

(9) 


where 


0 


G 


4 


-  Az 


Az  -Ay 

0  Ax 


Ay  -  Ax  o 


(10) 


is  skew-symmetric  ^nd  contains  only  the  translation  parameters  and  R  is 
the  rotation  matrix.  It  is  well  Known  in  matrix  theory  [1]  that  any 

skew-symmetric  matrix  K  must  have  even  rank,  say  2 n,  and  that  K,  if  real, 
always  assumes  the  following  normal  form: 
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K  =  Q* 


0  V? 

-f,  0 


o 

-%  0 


0  % 

-%  o 


(11) 


0 

where  Q  is  some  orthoncrmal  matrix,  not  necessarily  unique  and  the  y^’s  are 
real  constants.  Since  G  in  (10)  is  3x3  skew-symmetric ,  we  can  see  from 
the  above  that  G  must  be  singular,  and  that  there  exist  a  3x3  orthonormal 
matrix  Q  and  a  real  number  ¥  such  that 


G  =  Q 


o  <f 

-¥  o 


(12) 


Eq.(12)  will  play  an  important  role  in  the  analysis  hereafter. 
Let  P  =  i  £  where  ,  then  from  (10),  we  have 

P  =  i-E  =  i-G-R  =  H-R 

where 


(13) 


H  =  i-G  = 


0 

■i-Az 

i'Ay 


i-  Az 

0 

-i»Ax 


-i-Ay 

i-Ax 

0 


NCv-e  tha*-  hT  is  Hermitian.  Therefore,  (13)  gives  the  polar  decom¬ 
position  [1]  of  P.  Since  the  polar  decomposition  of  any  nonsingular 
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matrix  with  distinct  singular  values  is  always  unique  [1],  we  can  see 
tnatGand  R  would  be  unique  if  P  snould  satisfy  the  conditions  **ha** 
it  was  nonsingular  and  that  P*P  did  not  have  multiple  eigenvalues. 

(*  denotes  conjugate  transpose)  However,  we  have  seen  that  G  is 
always  singular,  which  implies  that  P  is  always  singular.  Further¬ 
more,  P  always  contains  multiple  singular  values  since 


ptP 


R-H-h-R  (*  denotes  conjugate  transpose) 
R*-HZ-R  =  R*(iG)(iG)-R  =  -R*G*R 


y> 

0 


0 


-V1 

V 

-r1 

•  Q-R  =  R  •  QT- 

v>2 

0_ 

1 

L  °_ 

(14) 


and  thus  the  eigenvalues  of  P*P  (or  the  square  of  the  singular  values  of 
P)  are  ^  and  0.  However,  we  shall  show  in  Theorem  I  that  because 
of  the  special  structure  of  G,  once  E  is  given,  G  and  R  are  unique. 


1II.1  UNIQUENESS  AND  ESTIMATION  OF  MOTION  PARAMETERS  GIVEN  E  :  THEOREM  I. 


THEOREM  I 

Let  the  SVD  of  E  be  given  by 

E  =  U  A  VT  (15) 

then  there  are  two  solutions  for  the  rotation  matrix 
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R 


(16) 


or 


(17) 


where  s  =  det(U)- det(V)  =  +1  or  -1 

and  one  solution  for  the  translation  vector  (up  to  a  scale  factor) 


Ax  ' 

~*l*2  1  *2*3_ 

Ay 

*  a 

+  1+2  1  *1+3 

Az_ 

1 

where  <j)i  is  the  ith  row  of  E,  i  =  1,  2,  3,  and  a  is  some  scale  factor. 
Furthermore,  although  U  and  V  are  not  unique  given  E,  once  a  particular  pair 
of  U  and  V  are  selected,  (16)  and  (17)  include  all  the  possible  solutions. 
However,  only  one  of  the  two  solutions  yield  positive  z  in  (5a)  and  (5b). 
Since  the  object  must  be  in  front  of  the  camera,  the  solution  is  unique. 


[Proof] 

Let  us  first  verify  the  uniqueness 
computational  formula  for  it. 


of 


Ax 

Ay 

Az_ 


given  E, 


and  give  the 


From  (9),  we  have 


E  ET=  G  R  RTGT=  G  GT=  -  GZ 


AzJ  +  Ay1- 

-  Ax -Ay 

-  A  x  •  Az 


-  Ax-Ay 
Az1  +  Ax1 
-Ay-Az 


-  Ax-Az 

-  Ay-Az 
A*1  +Ay: 


(18) 
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or  AZ*+Ay*=  ft 

Az‘+A^-  4T4 

A^  +  Ay*  =  4>r<fc 
Ax- Ay  = 
Ax-Az  = 

Ay-Az  = 


(19) 

(20) 
(21  ) 
(22) 

(23) 

(24) 


( 1 9 )+(20 )- (2 1  )  gives 

2-ca1--  4jT4>  *  4?  ft,  -ftfftj 

or  4.  o  =  ±  1//2"  (  'tf'fc  ♦  ftj'k  -ftlh?  (25) 

Similarly,  Ax  =  .  IrfT  i-tfft,  -  <feT<fe  *  tfft,  P  <2« 

A  y  =  r  1  (ftjft  -  ft/fti  +  <fffta  (27) 


Therefore,  given  E,  Ax,  Ay  and  Az  are  fixed  except  for  the  signs. 
When  a  particular  sign  for  Az  is  chosen,  the  signs  for  Ax  and  Ay 


are  determined  from  (28)  and  (29)- 


Ax' 


Thus  the  translation  vector 


Ay 

Az 


is  fixed  except  for  the  sign.  Since,  as  mentioned  twice  before, 
multiplying  E  or  G  with  any  scalar  does  not  alter  the  equality  of  (6), 

is  unique  up  to  a  scale  factor.  Alternatively,  since  there  is  a  common 
e  factor  among  the  translations,  Ax,  Ay  and  Az,  we  have  from  (23)  and 


Ax 

Ay 

Az_ 

sea' 


(24), 

'Ax' 

’+1*2  '  +2+3 

Ay 

=  a 

+  1+2  '  +1+3 

Az  _ 

1 

where  a  is  a  scale  factor.  We  now  proceed  to  prove  that  given  E,  there 
are  two  solutions  given  in  (17)  and  (18)  for  the  rotation  matrix  R  with 
only  one  among  the  two  yielding  z  in  (5a)  and  (5b)  with  the  same  signs 


before  and  after  the  motion. 
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From  (9),  (12)  and  (15),  we  have 
E  =  U A  VT=  G  R  =  QT 


0 

0 


C  R 


(28) 


Since  P*P  =  (i  E'f  (i  E)  =  ETE,  it  follows  from  (14)  that  V^and  0, 
wnich  are  the  squares  of  the  singular  values  of  P*P,  are  also  singular 
values  of  E  cJand  ETE.  Since,  as  mentioned  earlier,  multiplying  E  with 
any  scalar  will  not  influence  the  equality  of  (6)  and  will  only  scale  the 
translation  parameters  in  G,  we  can  always,  for  the  purpose  of  simplicity, 
set  in  (12)  to -£  without  losing  generality.  Thus  (28)  becomes 


E  =  U- 

"I 

1 

II 

*-> 

0  -1 
+  1  0 

0 

0 

Q-R 


(29) 


By  taKing  Q  as  UT ,  and  premultiplying  (29)  wi^h  llj  we  have 


~1 

T 

“0-1 

1 

0 

•  V  = 

+  1  0 

0 

(30) 


Let  the  ith  column  of  V  be  denoted  by  Vi,  and  the  ith  column  of  the 
product  QR  be  denoted  by  Qi ,  where  i=1,2,3.  Then  (30)  gives 


F  T  n 

VI 

-  Q2T 

V2T 

= 

■h  qit 

1 - 

o 

o 

L? 

_o  o  o_ 

Thus  02  =-V1 ,  QI  =  +V2.  Then  it  follows  from  ‘he  orthonormality  of  QR 
that  Q3  =  +  V3.  Thus 

R  =  Q^Q-R  =  U-Q-ft 


lb 


=  U  [+V2  -VI  +V5  ]  =  U 


0 

-1 


(3D 


where  s  =  +1  or  -1.  Since  R  is  orthonormal  of  the  firs4-  kind,  we  have 
from  (31  ) , 

"01 

-1  0  )•  det(V ) 


aet(R)  =  1  =  det(U)-det( 
=  det.(U).  s.det(V) 


Thus 


det(U)  det(V)  1  =  s  [det(U )]' [det(V)] 


=  s  •  1 


or  s  =  det(U)*  det(V).  Although  U  and  V  are  not  unique  given  E  si.ice 
the  multiplicity  of  the  sngular  values  of  E  is  2,  we  shall  show  later 
tnat  aue  to  the  special  structure  of  G,  the  solution  for  R  is  either 

VT  (32) 

and  no  others.  Furthermore,  only  one  of  (31)  and  (32)  can  be  accepted. 

Let  R1  and  R2  be  two  orthonormal  matrices  of  the  1st  kind  (i.e., 
det(RI)  =  det(R2)  =  +1  and  not  -1)  that  satisfy  (9),  i.e., 

E  =  G-R1  =  +  G-R2  (33) 

The  sign  in  (33)  comes  from  the  fact  explained  earlier  that  a  sign 
change  of  E  will  not  influence  the  equality  of  (6).  From  (33)  and  (12), 
tnere  exist  two  orthonormal  matrices  Q1  and  Q2,  not  necessarily  equal, 
such  that 


qit. 

.  1 

-»  o 

o 

_ _ 1 

•  Q1  -R 1  =  Q2T  • 

0  1 

-1  0 

OJ 

0 

given  oy  v  j  i  )  ,  or  oy 


R  =  U 


• Q2-R2 


(34) 
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where  G  =  Ql 


0 

•  1 


Ql  =  ±  Q2T- 


0  1 

-1  0 


Q2  (35) 


Firs^.,  we  snow  that  Ql  and  Q2  have  to  be  related  by  following 


Q2  = 


±i 


Ql 


where  K  is  a  2x2  orthonormal  matrix.  From  (9)  and  (12)  with  set  to 
1  as  explained  earlier ,  we  have 

£• ET=  G  R  RtGt=  -  G1 


t 

T 

'01  “ 

1  f  _ 

"01  ~ 

\ 

-Qi 

-1  0 

QiljQi7 

-1  0 

Qi>=  QiT 

i 

0_ 

Ji 

0_ 

i 

0. 

Ci  (36) 


Since  a-  hi  is  fixed  (including  the  sign)  given  ±  E,  we  have  from  (36), 


Ql 


Ql  =  Q2 


Q2 


(37) 


Premultiplying  (37)  by  Q 2  and  postmultiplying  by  Ql  give 


Q2-Q1 


Q2-Q1 


(33) 


Let  Q2*Q1T= 


ql 

q2 

q5" 

q^ 

q5 

q6 

,  then  from 

q7 

q8 

q9 

ql  q2  0 

q4  q5  0 

.q  7  q  8  0 


ql  q2  qq 

q^  q5  q6 

0  0  0 


which  implies  that  q3  =  q6  =  q7  =  o, 


or 


T 

ql 

q2 

0 

'L  I 

Q2-  Q  1T  = 

q4 

_  0 

q5 

0 

0 

q9 

r  i 

W 

Q9 

(39) 
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.  a  r 

where  w  = 


ql  q2 
q4  a  5 


(40) 


(alternatively,  one  can  snow  from  (35),  after  some  similar  derivation 
as  above,  that  to  has  to  be  either  [±1  0  or  0  +1  .  But  since  (40) 

I  0  +1  ±">0 

is  sufficient  and  handy  for  all  the  later  purposes,  it  is  simpler  just 
to  maintain  (40)).  Since  Ql  and  C2  are  both  orthonormal,  it  follows 
from  (39)  that  W  is  orthonormal  and  q9  =  +1.  Therefore, 


Q2  = 


Ql 


(41) 


Next,  we  substitute  (41)  into  (34)  to  obtain 


T 

Ql 

"o  1 
-1  0 

o 

zc 

ii 

O 

[*  1 

'  0  1  ^ 

-1  0 

w 

Ql  R2  =  Q1T 

toTK  W 

0. 

+1 

0 

+1 

0 

Ql  R2  (42) 


where  K  =j  0  VI.  Since  to  is  defined  by  (40),  we  have 

1-1  0 


wTK  to 


fd  1  q  4* 

‘  o  i]  Ic 

i'  q2l= 

-q3  qi  +  q3  ql 

-q3  q2  +  ql  q4 

|q2  q5_ 

[-1  Oj  [c 

13 

-q 4  q  1  +  q3  q2 

-q2  q4  +  q2  q4 

:  [  0  det(to"j]  =  r  0  ll  or  To  -i-] 
L-det(to)  0  J  L-1  0]  L1  °J 


Thus  (42)  gives 

~  0  1 

T 

~  0  s 

Ql  • 

-1  0 

0 

. Q1-R1  =  Ql  • 

o 

(/) 

* _ I 

Ql  •  R2 


(43) 


where  s  =  +1  or  -1.  Premultiplying  (43)  by  Ql  and  postmultiplying  by 


R  1*-Q  1T  give 


0  1 

0  1 

-1  0 

- 

-1  0 

o. 

0. 

s(Q  i  •  R2  -  R  l^Q  1T) 


(44) 


Let  b  =  Q1-R2-R1^QiT^ 


B2T 

B3T 


(45) 
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Tnus 


0 

1  - 

-1 

0 

=  S  ■ 

0_ 

Hence 

B2 =  s[ 0  1 

B1T=-s[-1  0 


i 

bit 

+sB2T 

0 

B2T 

— 

-sB  it 

0 

B3t 

0  0  0 

0] 

0]  =  s[1  0  0] 


(46) 

(47) 


Since  Q 1 ,  R1  and  R2  in  (45)  are  orthonormal,  and  that 


det(B)  =  det  ( Q 1 ) . det ( R2 ) •  det  ( r  1 )  *  det.  ( Q 1 )  =  (det(Q1)f*=  (±l)x  =  1 

we  see  that  B  is  orthonormal  is  orthonormal  of  the  1st  kind.  This 
fact,  together  with  (46)  and  (47),  imply  that 


:-T 


B5 '=  [0  0  1]  or  B(=  Q1- R2-R1^Q1T)=r 


Thus  R2  =  Q11 


Q1  Ri 


For  s  =  +1,  R2  =  Q1T-I-Q1-R1  =  RI 


(43) 


For  s  =  -1 , 


-1 


Cl  RI 


(49) 


.therefore ,  given  E,  if  we  regard  RI  as  a  reference  solution,  then  should 
there  be  any  other  solution  for  the  rotation  matrix,  it  must  satisfy 
(49).  We  now  show  that  although  Q1  is  not  unique,  (49)  remains  fixed 
for  different  choices  of  Q1. 

Let  C2  be  another  orthonormal  matrix  that  satisfies  (35)  or 
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(36)j  and  let  R3  =  Q2^ 


-1 


Q2  -R  1,  then  from  (41 ) , 


R3  =  Q 1- 


~-1 

r~  “ 

to 

-1 

to 

+  1 

1 

+1 

L.  - 

Q1-R1  =  QV 


-W  W 


+  1 


•Q 1  *  R 1 


=  Q1- 


-1 


+  1 


■Q 1  •  R  1 


(50) 


or  :  Q1' 


-1 


-1 


Ql-Rl  =  -R 1 


(51  ) 


(51)  is  obviously  not  a  solution  since  it  implies  that  det(R3)  =  -1, 
not  +1.  But  (50)  is  exactly  the  same  as  (49).  Note  that  (49)  implies 


that 


-1 


•Q1-R2 


1 


i.e.,  no  matter  which  solution  is  chosen  as  the  reference,  the  other 
solution  must  be  given  be  (49),  of  course. 

It  is  now  obvious  that  (16)  and  (17)  are  the  only  possible 
two  solutions  despite  the  fact  that.  U  and  V  are  not  unique,  since  if 
we  regard  (31)  as  the  reference  solution  R1,  then  the  only  other 


solution  must 

be 

given 

by 

_ 

R2  =  (? 

-1 

- 

1 

*01 

-1 

•Q 

•  R  1 

II 

*=U 

-1 

•Q-U- 

-1  0 

1 

1 

s 

*•3 

II 

II 

- 

0 

■\ 

-1 

•I- 

-1 

0 

•VT (since  Q  ; 

11 

c: 

_ 

1 

-4 

- 

S 
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=  U1 


0  -1 
1  0 


which  is  identical  to  (32).  We  now  show  that 


among  the  two  solutions,  exactly  one  of  them  must  yield  z  with  opposite 

signs  before  and  after  the  motion* 

“Since  the  E  matrix  in  (6)  has  nothing  to  do  with  the  geometry  of 

of  the  object  surface,  for  a  particular  point  with  image  correspondence 

(X,Y) _ »(X',Y'),  we  can  imagine  that  there  are  two  planes  passing 

througn  this  point  neither  of  them  containing  the  origin.  In  section 
IV,  we  snail  show  that  given  the  image  correspondences  of  the  points  on 
two  planes,  neither  of  which  containing  the  origin,  the  E  matrix  is  fixed. 
In  [3],  it  was  shown  that  there  are  two  solutions  for  the  rotation  matrix 
given  the  image  corrrespor.dences  of  one  plane  only  : 


R1  =01 


-S^  Sal 


•02 


(52) 


R2  =  01 


'  d  (9 

3^3  sd 


•02 


(53) 


where  01  and  02  are  some  3x3  orthonormal  matrices .  (Note  tha4-  *he  rows 
of  01  and  02  are  permutated  for  convenience.)  There  are  two  other 
solutions  corresponding  to  k<0  not  stated  in  [3](see  [3]  f°r  ne  ^e^- 
nition  of  tc)  because  it  was  proved  in  [3]  that  when  k<0,  the  object 

points  move  from  the  front  to  the  back  of  the  camera,  or  vice  versa.  It 
can  be  shown  using  exactly  the  same  procedure  as  in  Theorem  II  of  [3]  that 
these  two  other  solutions  are 


R  1  '  =  01 


s£  -Soi 


02 


(54) 


and  R2  '  =  01 


-o(  jS 
-S(3  -sd 


02 


(55) 
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Since  the  E  matrix  is  fixed,  it  was  proved  earlier  in  this  theorem 
•■hat  only  two  solutions  among  the  four  in  (52)-(55)  may  exist,  and  vhey 
must  be  related  precisly  by  (49).  There  are  only  two  sucn  possibilities, 
one  is 

-1 

-1  -01-R1  (56 ) 


R1  =  0  1 


1 


and  the  other  is 


R2  =  or 


-1 


01-R2 


(57) 


Therefore,  the  two  solutions  are  either  RijR1'  or  R2,R2'.  In  either 

case,  one  of  the  solution  must  be  one  among  (56)  and  (57),  which  corr¬ 
esponds  to  the  case  when  k  <  0  and  the  object  points  must  move  from  the 

front  to  the  back,  or  from  the  back  to  the  front  of  the  camera,  as  was 

indicated  above.  We  have  thus  proved  that  only  one  among  (16)  and  (17), 

or  equivalently  (48)  and  (49)  is  acceptable. 


*  END  OF  PROOF  FOR  THEOREM  I  * 


III. 2  ESTIMATION  OF  E  GIVEN  8  IMAGE  POINT  CORRESPONDENCES. 


Given  eight  image  point  correspondences  (Xi,Yi) — ^(Xi',Yi'), 
for  1=1,..., 8,  we  have  from  (6), 


XI  'XI 

XI  'Y 1 

XI  ’ 

Y1  'XI 

Y 1  'Y  1 

Y 1  ' 

XI 

Y1~ 

el 

-1 

X2'X2 

X2'Y2 

X2  1 

Y2'X2 

Y2'Y2 

Y2 ' 

X2 

Y2 

e2 

-1 

X3'X3 

X3'Y3 

X3 1 

Y3  'X3 

Y3'Y5 

Y3' 

X3 

Y3 

e3 

-1 

X4  'X4 

X4'Y4 

X4  * 

Y4'X4 

Y4  'Y4 

Y4 ' 

X4 

Y4 

e4 

-1 

X5'X5 

X5'Y5 

X5’ 

Y5'X5 

Y5'Y5 

Y5' 

X5 

Y5 

e5 

- 

-1 

X6'X6 

X6'Y6 

X6 1 

Y6'X6 

Y6'Y6 

Y6 ' 

X6 

Y6 

e6 

-1 

X7  'X7 

X7  'Y7 

X7  * 

Y7'X7 

Y7'Y7 

Y7 ' 

X7 

Y7 

e7 

-1 

X8  'X8 

X8  'Y  8 

X8* 

Y8'X8 

Y8'Y8 

Y8 ' 

X6 

Y8 

e8 

-1 

— 

(58) 
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Therefore,  el,e2,...,ed  can  be  estimated  by  solving  a  system  of  linear 
equations  expressed  in  (58).  The  conditions  when  the  ei's  are  unique 
(or  equivalently  when  the  8x3  matrix  in  (58)  is  nonsingular)  are  stated 
and  proved  in  Lemma  I  and  Theorem  II  in  Sec.  IV.  In  practice,  given 
eignt  image  point  correspondences,  one  first  substitute  the  image  point 
coordinates  into  the  above  8x8  matrix  and  check  its  determinant.  If  it 
is  nonzero,  the  matrix  E  can  be  determined  by  solving  (58)  for  the  ei's. 
Next  the  SVD  of  E  is  computed  and  used  to  calculate  the  actual  motion 
parameters  by  the  simple  formula  described  in  Theorem  I. 


IV.  RESTRICTIONS  ON  THE  SPATIAL  DISTRIBUTION  OF  OBJECT  POINTS  TO 
ENSURE  UNIQUENESS:  LEMMA  I  AND  THEOREM  II. 


Multiplying  (6)  by  z  and  z'  gives 


z'  [X'  Y' 


1] 


E  •  z- 


X 


Y 


=0 


1 


From  (q)  ana  (59), 


(59) 


[  X '  y '  z '  ]  •  E- 

X  " 

[x'  y'  z']-G-R- 

x" 

y 

=  0  or 

y 

2 

2 

_  m 

0 


(60) 
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Lei 


x 

y' 

z ' 


oe  transformed  from 


with  some  reference  rotation  matrix 


fto  and  translation  vector  To 


✓ 

X 

x" 

r 

✓ 

y 

:  Ro 

y 

+  To  =  Ro 

. 2 " 

zm 

L 

0 

A  zo 

zm 

"Ax  o' 

Ay° 

Azo 

>  ie., 

x“ 

’  Axo 

y 

+ 

Ay° 

z 

Azo 

(61) 


Le  t  Go  ~ 


■ 

Ayo 


o 

-  Axo 


-  Avo 

Ax0 

0 


and  Eo  =  Go  •  Ro  , 


Tne  purpose  of  this  section  is  to  investigate  how  many  image 
point  correspondences  are  needed  to  ensure  that  there  are  no  other 
solutions  to  G  and  R  as  factors  of  E  in  (9)  than  the  reference  Go  and 
Ro  that  can  satisfy  (59)  (or  (60)),  and  to  state  the  conditions 
or  restrictions  on  the  spatial  distribution  of  the  object  points  under 
observation  in  order  to  ensure  unique  solutions. 

Substituting  (61)  into  (60)  gives 

(  [x  y  z]  -RoT  +  To"'*)-  E' 


“  X 

[x  y  z]-Ro*E 

*X  ’ 

f 

"  X 

y 

— 

y 

n 

+  10  •  E  • 

y 

z 

w  m 

mZm 

.  z_. 

i — i 

X 

<< 

N 

— k 

T  °' 

"x  * 

r~~\ 

X 

*< 

N 

_ i 

V 

> 

[ToE  0] 

■v 

= 

Ro-E  0 

y 

+  ) 

0 

y 

0 

z 

0 

z 

_0  0  0  0_ 

l 

i 

L  V 
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[x  y  z  1] 

T  : 

o' 

V 

[x  y  z  1  ]  C 

"  X 

= 

Ro'E  : 

0 

y 

= 

y 

0 

z 

z 

tJe  ; 

"o 

1 

r  tJ°i 

T  :  0 

= 

fto-E  :  o 

= 

Ro-Gfl  :  0 

•  0 

•  0 

“'Tot'i'o" 

"ToGR '6' 

(62) 


(63) 


Note  that  if  C  is  skew-symmetric,  then  (62)  is  always  satisfied  regard¬ 
less  of  what  x,y,z  or  X,Y  are,  since 


2  •  [x  y 


X~ 

[x  y  z  1]-C- 

"  x~ 

f[x  y  z  1]  C 

X 

y 

= 

y 

+  J 

y 

z 

z 

1 

z 

_ 

1 

l 

-  1  .. 

[x  y  z  1  ]  -  C- 

”  x“ 

[x  y  z  l]-cT 

-  “1 

X 

y 

+ 

y 

z 

z 

[x  y  z  1  ]•  C* 

X*" 

[x  y  z  i  K-C)- 

"  x“ 

y 

-h 

y 

z 

z 

1 

1 

It  is  to  be  proved  in  Lemma  I  that  C  is  skew-symmetric  if 
and  only  if  E  =  Eo  (then  according  to  Theorem  I,  the  solution  for  the 
motion  parameters  is  unique;.  The  purpose  of  Theorem  II  is  to  prove 
that  the  matrix  C  in  (63)  has  to  be  skew-symmetric  if  the  object  points 
under  observation  do  not  reside  on  two  planes  with  one  of  the  two  planes 
containing  the  origin,  nor  do  they  lie  on  a  cone  containing  the  origin. 
We  note  that  five  or  fewer  points  in  space  can  always  be  traversed  by 
two  planes  with  one  plane  containing  the  origin,  and  that  six  or  fewer 
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points  in  space  can  always  be  traversed  by  a  cone  containing  the  origin. 

A  minimum  of  seven  points  is  needed  to  violate  these  two  conditions, 
.therefore,  it  follows  from  Theorem  II  and  Lemma  I  that  seven  points  in 
general  positions  can  ensure  a  unique  solution  for  the  motion  parameters. 


LEMMA  I 


The  necessary  and  sufficient  conditions  for  C  defined  by  (63)  to  be 
skew-symmetric  is  that 


or 


R  =  Ro 


Q  Ro 


1 


where  Q  is  a  5x2  orthonormal  matrix  such  that 


(64) 

(65 ) 


G 


and 


Ax 

—t 

Axo 

Ay 

=  o C 

Ayo 

Az 

Azo 

(66) 


(67) 


where  cA  is  some  constant.  (According  to  Theorem  I,  (65)  and  (67)  are 
equivalent  to  E  =©4 Eo) 


[Proof] 

If  C  is  skew-symmetric,  then  it  is  necessary  from  (63)  that 
Ro-G-R  =  -(RoTG  R)T 


(66) 
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and 


To  •  G  *  R  =  [0  0  0] 


or 


rWto  = 


(6S) 


(68)  gives 


Rev  G  •  R  =  -  R^Ro 


R^G-Ro 


Substituting  (66)  into  the  above  gives 


”  0  1 

„  „  T  T 

~  0  1 

no  w 

-1  0 

Q  R  =  R  0 

-1  0 

0_ 

0_ 

Q  Ro 


(70) 


Premultiplying  (70)  by  QR  and  postmulti plying  by  RT-QTgive 


Q  R  RoT  QT 


or 


~01 

O 

_ i 

1 

O 

11 

1 

O 

1 - 

|Q 

r 

0 

1 

0 

— k 

1 

1 

0 

— * 

_l 

-1  0 

o_ 

11 

r 

1 

0 

0 

i _ 

Q  Ro  RT  QT 


(71  ) 


where 


L  =  Q  R  RoT  QT=A 


V 

02 

03 

04 

05 

06 

07 

0'S 

09 

From  ( 71 )  and  ( 72  ) 


(72) 


-02 

01 

-05 

04 

_-06 

07 

Thus 

07 

=  08 

and 

02 

=  -02 

04 

=  -04 

01 

=  05 

J2 

-jl 

0 


0 

0 


05  j8 

•04  -07 

0  0 


Then  L  becomes 
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0  j3 

ji  J6 

0  j9_ 


(73) 


(72)  implies  that  L  is  orthonormal  of  the  is4-,  kind  since  R,  Ro ,  Go  are 
orthonormal  and  that  det(L)  =  det(Q)  det(R)  det(Ro)  det(Q)  =  (det(Q))*' 
=  (±1 T  =  1.  Taking  the  inner  product  of  the  1st  and  3rd  rows  of  L  in 

(73) ,  and  equating  it  to  zero  gives  j3 * J9  =  0.  Since  j9  ^  0  (other¬ 
wise  the  3rd  row  of  L  would  be  zero),  j3=0.  Similarly,  j6  =  0.  With 
these  and  the  fact  that  det(L)  =  1,  we  conclude  taht  L  can  assume  only 
the  following  forms: 


1 

L  = 

1 

or  L  = 

1 

1 

From  (72), 


R  =  Q 


Q-Ro  =  Ro 


or 


R  =  Q 


-1 


Q-Ro 


Thus  (64)  and  (65)  are  the  necessary  conditions  for  C  to  be  skew- 
symmetric.  The  next  thing  is  to  verify  (67). 

Premultiplying  (69)  by  R  gives 


GT-To 


0 

0 

0 


I 

<i 

<i 

o 

1 _ 

Axo 

"cT 

i 

t> 

N 

O 

£ 

Ay° 

= 

0 

Ay  -  Ax  0 

Azo 

0 

L  J 

which  gives 


Az  Ayo  -  Ay- A20  =  0 
-  Az  'A*°  +  Ax  Azo  =  0 
AyAX0  -  AxAy°  =  0 


Let.  oi  =  Az/Azo  »  then  &y  =  <<Ay 0  >  Ax  =c(.AX0  •  Hence 


Ax 

Axo" 

Ay 

= 

Ay° 

Az 

A  20 

£  =  G-R 


same  as 

(67). 

The  J 

1  matrix  then  is  equal 

d  a  scale 

factor 

since 

0 

Az 

-Ay 

-  Az 

0 

Ax 

R  Go  -Ro  =  ^  -So 

_  Ay 

0 

if  (64)  is  used,  or 


=  Go  QT 

1 

-1 

Q  Ro  =  o(.  QT 

"0  1 
-1  0 

q-qt 

-.1  - 
-1 

0 

Q  Ro 


=  oU1 


0  -1 
1  0 


Q  Ro  =  ~o(  Eo 


if  (65)  is  used. 


(Sufficiency  part) 

From  the  structure  of  C  in  (63),  it  is  obvious  that  in  order 
for  C  to  be  skew-symmetric,  the  row  vector  ToT-G-R  on  the  4th  row  has 
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to  be  equal  to  the  negative  of  the  transpose  of  the  4th  column,  which 
is  a  zero  vector,  and  that  the  3x3  matrix  Rd^G-R  on  the  upper-left 
corner  of  C  must  be  itself  skew-symmetric,  with  (67),  T?-G-R  in  (63) 
becomes 


To-G-R  =  [Axo  /y/o  A zo] 


0 

Azo 

-Ay° 

Azo 

0 

Axo 

Ay° 

-  /\xo 

0 

=  [-  Ayo  -A20-*-  Azc-Ayo  AX0  AZ0_  Az°Axo  -  Axo-Avo+ AVQ,AXQ^  r 


=  [0  0  0]  R  =  [0  0  0] 


(74) 


We  now  proceed  to  show  that  with  R  either  given  by  (64)  or  by  (65),  the 
3x3  submatrix  To-G-R  in  C  has  to  be  skew-symmetric. 

With  (64),  Ro- G • R  in  (63)  becomes 

Ro-G-ft  =  Ro-G-Ro  =  Ro-(-GT)-Ro  =  -(Ro  G  Ro )T  (75a) 

On  the  other  hand,  with  (65),  RcvG-R  in  (63)  becomes 

*T  T 

ho-  G-  R  =  Ro  •  G  • 

T  T 

=  Ro  •  Qt 

Thus 

(Ro-G-R)  =  (-Ro-G-Ro)"1"  =  Ro"^G-Ro  =  -RoT-G-R  (75b) 

(75a)  and  (75b)  shows  that  either  with  (64)  or  (65),  Rc>G-R  is  skew- 
symmetric.  This  fact,  together  with  (74),  imply  that  C  in  (63)  is 


Q-  Ro  =  Ro  -Q  - 


0 

-1 


-1 

0 


■Q-Q' 


Q  -Ro 


Q  Ro  =  -Ro-G-Ro 


SKew-symmetric . 
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*  END  OF  PROOF  FOR  LEMMA  I  * 


THEOREM  1] 


If  CX'  Y '  1  ]  E 


=  0  is  satisfied  by  the  image  point  correspondences 


of  a  group  of  object  points  not  lying  on  two  planes  with  one  plane  containing 

the  origin,  nor  on  a  cone  containing  the  origin,  then  the  C  matrix  in 
(63)  has  to  be  skew-symmetric. 


[Proof ] 


From  (62),  which  is  the  necessary  condition  of  (6),  we  have 


[x  y  z  1  ]  C 


[x  y  z  i  ]  C 


\T 

=o 


or 


[x  y  z  1  ](  C  +  C  ) 


From  (63) 


,T\  r 


C  +  CT  = 


=  0 


Ro^E  +  E^Ro 


ToT-G-R 


ET?o 


(76) 


C  +  CT= 


Ho*-  G  •  R  +  R^GT-Ro 


ToT-  G  •  R 


rV^To 


Substituting  (12)  into  the  above  gives 
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C  +  CT  = 


Ro  -  QT 

"  0  1 
-1  0 

■Q-R  -  RT-QT 

1 

1 

-*  O 

o 

1 

t 

-Q-Ro  | 

-rt-  q- 

"  0  1 
-1  0 

0_ 

0_ 

1 

1 

1 

0 

1 

1 

1 

1 

To  -  Q 


1 

0 


C-fi 


•0  -To 


rV 


Q-R-  Ro-  QT 


o 

_ 1 

o 

—1 

o 

1 

- 

O 

1 

0_ 

0. 

Q-Ro-RT-QT  | 


0  1 
-1  0 


•Q-To 


0  0  0 


T  T 

To- Q 


0  1 
-1  0 


!  0 

Q-R 

!  o 

!  o 

0  0  0 

1 

I 

!  1 

Q-R 


0  0  0 


Tr 


"  0  1 

‘o  1  ‘ 

1 

■  1 

0  1 

-1  0 

- 

-1  0 

•mt|  - 

-1  0 

0 

CL 

1 

1 

o 

■To ' 


To 


0  1 
-1  0 


Q-R 


0  0  0 


(77) 


where  M  =  Q  •  R  •  Ro"- QT 
To'=  Q-To  = 

ml  m2  m3 

m4  m5  m6 

m7  m8  m9 
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Then  (77)  becomes 


—  - 

T 

— 

T 

Q  R 

2  m4 

m5  ml 

m6 

-t  2 

Q  R 

c  +  c  = 

m5-m1 

-2  m2 

-m3 

1 1 

1 

mo 

-m3 

0 

0 

1 

-t  2 

1 1 

0 

0 

Let  the  original 

cordnate 

system  be 

rotated 

with  R * Q 

such  that 

- 

— 

— r 

(78) 


yc 


Q-R' 


y 

z 


(79) 


then  from  (76)  and  (78), 


[xc  yc  zc  1  ]  •  J  • 


=  0 


(80) 


wnere 


J  = 


2  m4 

m5  -ml 

m6 

-t2 

m5-m1 

-2  m2 

-m3 

tl 

m6 

-m3 

0 

0 

-t.2 

1 1 

0 

0 

(81  ) 


(80)  gives 


2[m4-x*+  (m5-ml  )xc-yt-m2- yc1’-t2-xc+  1 1  •  y<.  +  (mo.  ^ -  m3-yc)zc]  =  0  (82) 

or 

z  =  )x^yc -ra2-ycz-t2-xc+ti.yc]/(m6.x<rra3*yc)  (83) 


Unless  J  in  (81)  is  identically  zero,  (82)  indicate  that  all  the 
points  must  lie  on  a  Quadric  surface  of  some  type  containing  the 
origin.  However,  (83)  implies  that  zt  is  a  single-valued  function 
of  xc  and  yc  unless  m6*^-  m3  •  yc  =  0.  There  are  two  cases  to  be 
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discussed.  The  first  is  wnen  m6 ■ xc-  m3 • ycdevides  the  numerator.  Then 
(83)  must  be  a  1st  order  polynomial,  say  a-x^*  b-yc  +  c.  Thus  (82) 
becomes  (zc-  a-^-  b- yc  -  c)>(m6-xc-  m3-yc)  =  0,  which  implies  that 
in  the  new  coordinate  system,  all  the  points  must  lie  on  two  planes 
with  one  plane  vertical  and  passing  through  the  origin.  Since,  as  in 
(79),  the  new  coordinate  system  is  obtained  by  rotating  the  old  coor¬ 
dinate  system  around  an  axis  through  the  origin,  these  two  planes  must 
still  be  two  planes  with  one  plane  passing  through  ‘‘he  origin  in  the 
old  coordinate  system  except  that  it  is  not  necessarily  vertical. 

The  second  case  is  when  mS-x^-  m3-yt  does  not  devide  the  numerator  in 
(83).  In  this  case,  zc  must  be  +ooor-|-  (i.e.,  indeterminate)  along 
tne  line  mo-x^  m3-yc=  0,  while  for  other  values  of  (xt,yc),  zt  has  to 
be  single-valued.  It  is  well  Known  that  any  quadric  surface  must  fall 
in  one  of  the  following  categories  [29]: 

(1)  imaginary  quadric  surface  (e.g.,x£+  y<*+  z|=  -1) 

(2)  ellipsoid 

(3)  hyperboloid  of  one  sheet 

(4)  hyperboloid  of  two  sheets 

(5)  elliptic  paraboloid 

(6)  hyperbolic  paraboloid 

(7)  elliptic  cylinder 

(8)  hyperbolic  cylinder 

(9)  parabolic  cylinder 

(10)  a  cone 

(11)  two  planes 

Since  zt  is  single-valued,  the  surface  expressed  in  (83)  cannot  be 


ellipsoid  or  cylinder  of  any  type.  Paraboloid  also  is  not  possible 
since  zc  is  oo  or  indeterminate  along  the  line  m6»  xc-m3- yc  =0  and  as 
can  be  seen  in  Fig.  2  and  3,  no  such  possibility  can  exist  either 
for  the  elliptic  paraboloid  or  hyperbolic  paraboloid.  Hyperboloid 
of  one  sheet  should  be  excluded  for  consideration  since,  as  is  depicted 
m  Fig.  k,  this  type  of  surface  cannot  be  single-valued  in  Zg..  It 
might  seem  that  hyperboloid  of  two  sheets  in  Fig.  5  with  one  of  the 
separating  hyperplanes  vertical  to  ‘‘he  (Xg.,yc)  plane  and  containing  the 
zcaxis  could  be  qualified  since  it  is  single-valued  in  zc  except  along  a 
line  passing  through  origin,  where  zc  is  ±oo.  However,  since  the  surfac 
must  contain  the  origin  as  was  explained  earlier,  one  sheet  of  the  two 
in  Fig.  5  must  touch  the  vertical  separating  hyperplane.  But  it  is  well 
known  in  geometry  that  if  a  hyperboloid  intercepts  its  separating  plane, 
it  must  degenerate  into  a  cone  as  depicted  in  Fig.  6,  in  which  case  the 
intersection  must  be  the  Zq  axis.  Therefore  we  conclude  that  unless  J 
in  ( 8 1 )  is  a  zero  matrix,  all  the  points  must  either  lie  on  two  planes 
with  one  plane  containing  the  origin,  or  on  a  cone  passing  through  the 
origin.  But,  as  was  defined  in  (78), 


C 


+  C 


T 


therefore , 
or 


— 

T 

—  — 

!  o 

!  o 

Q  R  |0 

Q  R  !  0 

!  o 

•  J  • 

!  0 

o  o  o  !  i 

o  o  o  !  i 

C  +  CT=  0 
C  =  -CT 


which  means  that  C  has  to  be  SKew-symmetric . 


*  END  OF  PROOF  FOR  THEOREM  II  * 
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Fig.  2 


Elliptic  Paraboloid  can  be  single-valued  in  z^,  but  cannot 
diverge  along  a  straight  line. 


Fig.  3  Hyperbolic  paraboloid  can  be  single-valued  in  Zy  but  it  cannot 
diverge  along  a  straight  line. 
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Fig.  4  Hyperboloid  of  one  sheet  cannot  be  single-valued  in  z t. 


Fig.  5  Hyperboloid  of  two  sheets  with 


vertical  separating  hyperplane. 


degenerate  into  a  cone 
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COROLLARY  I 

Given  the  image  correspondences  of  two  planes  not  passing  through 
the  origin,  the  motion  is  unique. 

[Proof ] 

Since  neither  a  cone  nor  two  planes  with  one  plane  passing  through 
the  origin  can  contain  two  planes  not  passing  through  the  origin,  it 
follows  from  Theorem  II  that  the  C  matrix  in  (63)  has  to  be  skew- 
symmetric.  Then  the  uniqueness  of  the  motion  parameters  follow  direct¬ 
ly  from  Lemma  I.  Q.E.D. 


COROLLARY  II 

Given  the  image  correspondences  of  six  points  with  four  points  on 
one  plane  not  containing  the  origin,  four  points  on  the  other  plane  also 
not  containing  the  origin ,  and  two  points  common  to  the  above  two  groups 
of  four  points  on  the  intersection  of  the  two  planes  can  ensure  unique 
solutions  for  the  motion  parameters. 

[Proof ] 

Since  as  was  proved  in  [20],  the  image  correspondences  of  four 
points  with  none  of  the  three  points  colinear  determine  the  image  motion 
of  the  whole  plane,  we  can  see  that  the  six  points  with  four  points  on 
one  plane,  four  on  the  other  plane  can  determine  the  image  correspondence 
of  two  planes  not  containing  *-he  origin.  Therefore,  it  follows  from  Coro 
llary  I  that  the  motion  parameters  are  unique.  Q.E.D. 
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COROLLARY  III 

Tne  image  correspondences  of  four  points  on  a  plane  not  passing 
'-hrough  the  origin  and  two  other  points  not  on  this  plane  determine  the 
motion  parameters  uniquely. 

[Proof] 

Obviously,  on  the  very  plane  determined  by  the  four  points,  whose 
image  correspondences  can  be  determined  from  these  four  points  according 
to  [20],  there  always  exist  two  points  that  are  coplanar  wi^h  the  other 
two  points  not  on  this  plane.  Therefore,  it  follows  from  Corollary  II 
that  the  motion  parameters  are  unique.  Q.E.D. 

COROLLARY  IV 

Given  the  image  correspondences  of  seven  or  more  points  not 
traversable  by  two  planes  with  one  plane  containing  the  origin,  nor  by 
a  cone  containing  the  origin,  the  motion  parameters  are  unique. 

[Proof] 


If  one  of  the  image  points  before  motion  is  chosen  to  be  at 
the  origin,  which  can  always  be  done,  then  should  there  be  a  cone  con¬ 
taining  the  origin  passes  through  all  the  points,  one  of  the  separating 
nyperplane  of  the  cone  already  passes  through  the  z  axi*.  Therefore, 
'-he  rotation  matrix  QR  in  (79)  need  only  rotate  the  original  coordinate 
system  around  the  z  axis  in  order  to  arrive  at  (81),  or 
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Q-fl  = 


wnere  w  is  some  2x2  orthonormal  matrix.  Then  from  (78) 


r 

—  — 

w 

W 

C  +  CT  = 

+1 

•  j  • 

+  1 

1 

_  ~ 

T 

i  +m6 

-t2 

w  -N •W 

i 

i 

!  +n3 

1 1 

+mo  +ra3 

!  o 

1 

0 

-t2  tl 

!  o 

0 

N  £ 


where  .  2-m4  m5-m1 

m5-m1  -2  m2 

Therefore,  even  in  the  original  coordinate  system,  the  surface  is 
still  given  by  the  equation  in  the  form  of  (82).  Since  (82)  contains 
seven. terms  with  six  effective  coefficients,  there  is  always  a  unique 
cone  containing  the  origin  that  passes  through  six  points  in  general 
positions,  while  no  such  cone  exists  that  contain  the  origin  and  passes 
through  seven  points  in  general  positions,  nor  can  two  planes  with  one 
plane  containing  the  origin .  Thus  we  conclude  that  given  seven  or  more 
image  point  correspondences  in  general  positions,  the  matrix  C  in  (63) 
has  to  be  skew-symmetric  and  the  motion  parameters  can  be  uniquely 
determined.  Q.E.D. 


Since  Corollary  IV  only  gives  the  sufficient  condition  for  unique¬ 
ness,  even  if  the  seven  points  are  traversable  by  two  planes  with  one 
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plane  passing  through  the  origin,  or  by  a  cone  containing  the  origin, 
the  motion  parameters  might  still  be  unique  in  some  situations.  For 
example,  if  six  among  the  seven  points  satisfy  the  condition  stated  in 
Corollary  III,  then  the  motion  parameters  are  unique  even  if  there  may 
be  two  planes  passing  through  these  Swven  points  with  one  plane  contain¬ 
ing  the  origin. 


From 

(82),  the 

criteria 

for 

whether 

there  exists  a  cone 

containing 

the  origin 

that  passes 

through 

n  points 

is  whether 

the 

following  n 

by  7  rectangular 

matrix  has  full  column 

rank  or  not. 

X 

X 

x  1 

xl-y  1 

y1 

x  1 

y1 

z  1-xl 

z  1*y  1 

x2" 

x2y  2 

y2‘ 

x2 

y2 

z2x2 

z2y  2 

xn1* 

xr,yn 

yn1 

xn 

yn 

znxn 

zn-yn 

However,  since  only  the  image  coordinates  are  given,  the  only  useful 
criteria  available  is  whether  or  not  the  8x8  matrix  in  (58)  is  non¬ 
singular  or  not.  If  it  is  nonsingular,  one  can  solve  for  the  E  matrix, 
compute  its  SVD,  and  then  use  the  formula  in  Theorem  I  to  calculate 

the  actual  motion  parameters.  The  following  two  corollaries  state  the 
necessary  and  sufficient  conditions  for  the  8x8  matrix  in  (58)  to  be 
singular. 

Corollary  V 

Given  the  image  correspondences  of  eight  points  among  which  more 
than  six  points  are  coplanar,  the  8x8  coefficient  matrix  in  (58)  is 
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singular. 

[Proof] 

Let  H  be  defined  as  the  8x8  coefficient  matrix  in  (58),  i.e.. 


XI 

'XI 

X 1  'Y  1 

XI ' 

Y 1  'XI 

Y 1  'Y 1 

Y 1  ' 

XI 

Y 1 

X2 

'X2 

X2'Y2 

X2‘ 

Y2'X2 

Y2'Y2 

Y2 ' 

X2 

Y2 

X3 

'X3 

X3'Y3 

X3; 

Y3'X3 

Y3'Y3 

Y3' 

X3 

73 

X4 

'X4 

X4  'Y 4 

XU1 

X51 

Y4'X4 

Y4'Y4 

Y4 ' 

X4 

Y4 

X5 

'X5 

X5'Y5 

Y5'X5 

Y5'Y5 

Y5 ' 

X5 

Y5 

X6 

"X6 

X6  'Y 6 

xe' 

Y6'X6 

Y6'Y6 

Y6 ' 

X6 

Y6 

X7 

"XI 

X7  'Y7 

GO 

X  X 

Y7'X7 

Y7'Y7 

Y7 ' 

X7 

Y7 

X8 

'X8 

Xe'YS 

Y8'X8 

Y8'Y8 

Y8 ' 

X8 

Y8 

We  shall  prove  that  if  at  least  seven  among  the  eight  points  are  coplanar 
in  the  object  space,  H  is  singular.  Since  interchanging  the  rows  of  H 
will  not  alter  the  singularity  of  H,  we  can  assume  without  losing  gener¬ 
ality  that  the  first  seven  object  points  corresponding  to  the  first  seven 
rows  of  H  are  coplanar.  Let  Hz  be  defined  as 


zl-zl 1 

z2-z2 ' 


Hz  = 


0 


•  H 


(85) 


z8-z8 

1 

xl’xl 

x2'x2 

• 

xl'yl 

x2’y2 

• 

xl'zl 

x2’z2 

• 

yl’xl 

y2'x2 

• 

yl'yl 

y2'y2 

• 

yl'zl 

y2'z2 

• 

zl  *xl 

y2'x2 

• 

zl'yl 

z2'y2 

• 

• 

• 

x8  *x8 

• 

• 

x8  ’y8 

• 

• 

x8’z8 

• 

• 

y8  'x8 

• 

• 

y8  'y8 

• 

• 

y8'z8 

• 

• 

z8  'x8 

• 

• 

z8 ' y8 
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From  (85), 


8 

det  (Hz)  =  (  II  zi  zi')  •  det  (H) 

i=l 


(86) 


Since  the  object  points  must  be  in  front  of  the  camera  lense  in  order  to 
be  imaged,  zi  and  zi*  are  greater  than  1  (the  normalized  focal  length) 
for  i  =  1,  8.  Therefore,  from  (86),  det  (Hz)  =  0  if  and  only  if 

det  (H)  =  0,  i.e.,  H  is  singular  if  and  only  if  Hz  is  singular.  We  now 
prove  that  the  first  seven  rows  of  Hz  must  be  linearly  dependent. 

Let  the  7x8  submatrix  of  Hz  corresponding  to  the  first  seven  rows 
be  denoted  by  B.  Since  the  first  seven  points  are  assumed  to  be  co- 
planar,  from  [3],  we  have 


”  ■ 

-  <« 

xi  1 

xi 

yi' 

=  k  A 

yi 

U\ 

- 1 

•  rl 

N 

_ 1 

for  i  =  1,  ...,  7,  where 


al 

a2 

a3 

A 

= 

a4 

a5 

a6 

a7 

a8 

1 

(87) 


ai's  are  the  "pure  parameters"  defined  in  [2]  and  [3], 
k  is  some  constant. 

Let  D  be  defined  as 


xl 

yi 

zl 

xl-yl 

xl*zl 

yl-zl 

x22 

• 

y22 

• 

z22 

•- 

x2*y2 

• 

x2*z2 

• 

y2*z2 

• 

j. 

y72 

• 

• 

x7-y7 

• 

• 

x7-z7 

• 

• 

y7»z7  m 

Therefore , 
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al 

0 

0 

a4 

0 

0 

a7 

0 

0 

a2 

0 

0 

a5 

0 

0 

a8 

0 

0 

a3 

0 

0 

a6 

0 

0 

A 

B  =  D 

=  D  •  L 

(88) 

a2 

al 

0 

a5 

a4 

0 

a8 

a7 

a3 

0 

al 

a6 

0 

a4 

a9 

0 

0 

a3 

a2 

0 

a6 

a5 

0 

a9_ 

Since,  as  can  be  seen  in 

(88),  B 

is 

the 

product 

of  a 

7 

x  6  matrix 

D  and  a 

6x8  matrix  L,  the 

column 

and  row 

rank 

of  B 

can 

be  . 

at 

most  6.  To 

elaborate 

on  this,  since  D  is 

a  7 

x  6 

matrix. 

the 

SVD 

of  D 

is  given  by 

where 


D  =  IL 


0  0  ....  0 


Xl 


A2 


Xi's  are  the  singular  values  of  D 


Up  is  a  7  x  7  orthonormal  matrix 
Vp  is  a  6  x  6  orthonormal  matrix. 


Then  (88)  becomes 


X6 


B  =  U„ 


Ar 


0  0  ...  0 


=  u 


ad  •  VS  •  L 


0  0 


0 
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or 


t,  •  o  = 

D  [0  0  .  .  .  .  0 


(89) 


Since  Up  is  orthonormal,  the  row  rank  of  B  is  the  same  as  that  of  Up*B. 

T 

But  the  last  row  of  U^-B  is  zero,  as  can  be  seen  in  (89).  Therefore,  the 


row  rank  of  B  can  be  at  most  6.  Since  B  is  the  7x8  submatrix  of  Hz,  one 
of  the  first  seven  rows  of  Hz  can  be  expressed  as  a  linear  combination  of 
the  others.  Therefore,  Hz  is  singular,  which  implies  that  H  is  singular. 


Q.  E.  D. 


Corollary  VI 

If  the  8x8  coefficient  matrix  H  containing  the  image  correspondences 
of  eight  points  in  (58)  is  singular,  then  either  seven  or  eight  points  are 
coplanar  in  the  object  space,  or  the  eight  object  points  are  on  a  cone 
containing  the  origin. 

[Proof] 

Corollary  IV  implies  that  if  the  motion  parameters  are  not  unique, 
or  equivalently  the  E  matrix  is  not  unique  and  H  in  (58)  is  singular,  the 
eight  points  are  either  traversable  by  two  planes  with  one  plane  containing 
the  origin,  or  by  a  cone  containing  the  origin.  This  conclusion  is  certainly 
correct  but  can  be  made  stronger  since  there  are  cases  when  the  eight  points 
are  traversable  by  two  planes  with  one  plane  containing  the  origin  while 
the  motion  parameters  are  still  unique.  According  to  Corollary  III,  so  long 
as  four  among  the  eight  points  are  on  a  plane  not  containing  the  origin,  and 
two  other  points  not  on  this  plane  determine  the  motion  parameters  uniquely. 
Obviously  there  are  only  three  possibilities  for  this  to  happen  when  the 
eight  points  are  traversable  by  two  planes  with  one  plane  containing  the  origin; 
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(1)  Six  points  are  on  a  plane  not  passing  through  the  origin,  and  two 
points  on  another  plane  containing  the  origin. 

(2)  Five  points  are  on  a  plane  not  passing  through  the  origin,  and  three 
points  on  another  plane  containing  the  origin. 

(3)  Four  points  are  on  a  plane  not  passing  through  the  origin,  and  four 
points  on  another  plane  containing  the  origin. 

This  leaves  only  the  following  two  cases  which  have  been  shown  in  Corollary 
V  to  be  the  sufficient  conditions  for  H  to  be  singular: 

(1)  Exactly  seven  points  among  the  eight  are  on  a  plane  not  passing  through 
the  origin. 

(2)  All  the  eight  points  are  on  a  plane  not  passing  through  the  origin. 

Therefore,  the  assertion  of  the  corollary  is  justified. 

Q.  E.  D. 

The  results  developed  in  this  paper  can  also  be  applied  to  the  stereo 
imaging  problems  in  photogramme try  and  computer  vision  without  assuming  the 
relative  orientation  of  the  two  cameras  since  pictures  taken  at  two  time 
instances  can  be  regarded  as  taken  by  two  cameras  at  one  instance.  After 
the  motion  parameters  are  computed  using  the  formula  in  Theorem  I,  the 
surface  structure  of  the  object  can  be  determined  up  to  a  common  scale 
factor  by  computing  the  z  coordinates  using  (5a)  or  (5b). 


V.  PURE  ROTATION  AND  PLANAR  PATCH  MOTION 

Note  that  when  the  object  undergoes  pure  rotation  around  an  axis 
through  the  origin,  Ax  =  Ay  =  Az  =  0,  and  therefore,  from  (7),  E  is  a  zero 


50 


matrix.  The  converse  is  also  true  since  if  E  =  0.  (0.  stands  for  a  3  x  3 

T  T 

zero  matrix),  then  from  (9),  G  =  ER  ®  OR  =  0,  i.e,,  Ax  =  Ay  =  Az  =  0. 

In  this  case,  the  results  described  earlier  in  this  paper  cannot  be  applied 
since  (5a)  and  (5b)  become  z  =  0/0,  and  are  no  longer  meaningful.  However, 
it  is  to  be  seen  in  the  following  that  the  image  motions  for  the  case  of 
three-dimensional  pure  rotation  are  equivalent  to  the  image  motions  of  any 
planar  patch  undergoing  three-dimensional  pure  rotation  with  the  same  rota¬ 
tion  parameters  0,  nl ,  n2,  and  n3 •  This  means  that  even  if  the  object 
surface  is  nonplanar,  the  motion  parameters  can  still  be  computed  using  the 
results  described  in  [3]  for  the  planar  patch  motion.  Furthermore,  since 
the  motion  parameters  have  been  proved  to  be  unique  for  a  rigid  planar  patch 
undergoing  three-dimensional  pure  rotation  (see  Theorem  III  in  [3]),  the 
motion  parameters  for  any  curved  surface  undergoing  three-dimensional  pure 
rotation  are  also  unique,  A  simple  test  for  detecting  the  presence  of  pure 
rotation  and  the  planar  patch  motion  will  also  be  described. 

By  setting  Ax,  Ay  and  Az  in  (4a)  and  (4b)  to  zero,  we  have 

v  t  -  T1  *  X  1  r2  -  Y  +  r3 

r7  •  X  +  r8  •  Y  +  r9 

(90) 

f  __  r4  •  X  +  r5  *  Y  +  r6 

Y  r7  •  X  +  r8  •  Y  +  r9 

It  can  be  seen  from  [2,3]  that  (90)  gives  the  image  mapping  (X, Y)  ->  (X 1 , Y 1 ) 
of  a  rigid  planar  patch  undergoing  3-D  motion  with  the  3  x  3  A  matrix 
containing  the  pure  parameters  in  [2,3]  being 


Let  Ua  +  R,  Va 


A 


I, 


Then  (91)  becomes 


A 


V  T 
a 


(91) 


(92) 
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Since  R  and  I  (and  thus  Ua  and  Va)  are  orthonormal,  (92)  is  the  singular 
value  decomposition  of  A  with  three  identical  singular  values.  Therefore, 
according  to  Theorem  III  in  [3],  (90)  gives  the  image  point  correspondences 
of  any  rigid  planar  patch  undergoing  3-D  pure  rotation  with  rotation  matrix  R, 

We  now  describe  a  simple  procedure  for  detecting  whether  the  object 
points  are  on  a  planar  patch  or  are  undergoing  3-D  pure  rotation  (given 
eight  or  more  image  point  correspondences),  which  are  the  cases  when  (58) 
are  not  to  be  applied,  and  the  motion  parameters  have  to  be  computed  using 
the  resutls  in  [2,3,4], 

From  [2]  and  [3],  the  following  mapping  characterizes  image  corres¬ 
pondences  of  n  object  points  on  a  rigid  planar  patch  undergoing  3-D  motion: 


X*  1  -  abXi  +  a2-Yi  +  a3 

A1  “  a7*Xi  +  a8-Yi  +  1 

(93) 

.  |  _  a4«Xi  +  a5*Yi  +  a6 

Yl  "  a7*Xi  +  a8-Yi  +  1 

for  i  =  1,  2,  •  •  • ,  n,  and  al,  ...,  a8  are  some  constants.  Rewriting  (93) 
as  a  matrix  equation  with  the  aifs  as  the  unknowns  gives 


al 

a2 


M 


B 


(94) 


where  the  2n  x  8  matrix  M  is  given  by 
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Therefore,  given  eight  image  point  correspondences,  one  first  examines  the 
consistency  of  the  16  x  8  matrix  equation  in  (94).  If 

# 

rank  (M)  =  rank  (M  l  B) 

• 

then  (94)  is  consistent.  An  efficient  way  of  checking  the  consistency  of 
(94)  is  to  solve  the  following  8x8  normal  equation  of  (94)  for  the  least 
square  solution  of  (94): 


T 

M  M 


al 

a2 


T 

=  MB 


The  solution  of  the  above  normal  equation  is  then  substituted  back  to  (94). 
If  it  is  satisfied,  (94)  is  consistent.  The  solution  will  then  be  used  to 
form  the  3  x  3  A  matrix  defined  in  [2,3].  If  the  singular  values  of  A  are 
all  identical,  the  motion  consists  of  pure  rotation  around  an  axis  through 
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the  origin  only.  In  this  case,  the  rotation  matrix  R  is  equal  to  A  multi¬ 
plied  by  a  constant  (which  is  equal  to  the  inverse  of  the  norm  of  any  column 
of  A  since  R  is  orthonormal)  (See  Theorem  III  in  [4]).  If  (94)  is  not  con¬ 
sistent,  one  solves  (58)  for  the  E  matrix,  and  then  computes  the  actual 
motion  parameters  using  the  method  described  in  Theorem  I  of  Sec.  III.l. 

VI.  NUMERICAL  EXAMPLES  FOR  THE  CASES  WHEN  FIVE  AND  SIX  POINTS  CAN  YIELD 
TWO  SOLUTIONS 

Note  that  Theorem  II  only  gives  the  sufficient  conditions  for  unique¬ 
ness.  Although  there  always  exists  a  cone  passing  through  six  points  in 
general  position  and  the  origin,  this  does  not  imply  that  there  are  two 
solutions,  one  for  the  case  when  C  is  skew-symmetric  and  the  other  not 
skew-symmetric.  Experimental  results  show  that  six  points  are  usually  but 
not  always  sufficient  to  yield  unique  solution.  In  fact,  even  five  points 
are  sometimes  sufficient.  The  following  are  two  numerical  examples  for  the 
cases  when  five  and  six  points  are  not  sufficient  to  ensure  uniqueness  of 
solutions  for  the  motion  parameters.  In  these  two  examples,  the  image 
point  correspondences  were  obtained  by  simulation.  First,  the  image  coor¬ 
dinates  at  tl  of  a  number  of  object  points  with  randomly  chosen  object  space 
coordinates  (xi,  yi,  zi),  i  *  1,  2,  ...,  n  (n  a  5  for  Example  1,  and  6  for 
Example  2),  are  obtained  using  (3).  Next  the  object  points  are  rotated  with 
some  reference  rotation  parameters  0Q,  nQ^,  n^,  n03>  n03*  anc*  translated 
with  some  reference  translation  parameters  Axo,  Ayo,  Azo  (=1),  with  com¬ 
puter  simulation  using  (1)  to  obtain  (xi1,  yi 1 ,  zi1),  i  =  1,  ...,  n.  Then 
the  image  coordinates  of  these  n  points  at  t2,  i.e.,  (Xi1,  Yif),  i  *  1,  2, 

•«.,  n,  were  computed  using  (3).  These  n  simulated  image  point  correspondences 
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(Xi,Yi)  (Xi',Yi’),  i  =  1,  2,  n,  were  then  substituted  into  (6)  to 

obtain  n  simultaneous  nonlinear  equations,  one  for  each  image  point  corres¬ 
pondence  (Xi,Yi)  ->  (Xi',Yi').  The  motion  parameters  in  E  of  (6)  with  Az 
set  to  1  were  obtained  by  solving  this  system  of  nonlinear  equations  using 
global  search.  For  each  of  the  following  two  examples,  two  solutions  were 
found . 

[Example  1]  Five  point  case. 

The  object  coordinates  of  the  five  points  at  tl : 


(xl, 

yi, 

zl) 

=  (3.0, 

15.7, 

5, 

.0), 

(x2 , 

y2, 

z2)  =  (28.1, 

15.0,  32.3) 

(x3 , 

y3, 

z3) 

=  (5.0, 

12.9, 

7 

.0), 

(x4 , 

y4, 

z4 )  =  (32.7, 

24.7,  18.0) 

(x5, 

y5. 

z5)  = 

(13.1, 

31.0, 

22, 

.2). 

By  using  (3),(Xi,  Yi),  i  =  1,  ...,  5,  were  found  to  be: 

(XI,  Yl)  =  (0.6,  3.14),  (X2 ,  Y2)  =  (0.869969,  0.464396) 

(X3,  Y3 )  =  (0.714286,  1.842857),  (X4 ,  Y4)  =  (1.816667,  1.372222) 

(X5 ,  Y5 )  =  (0.590090,  1.396394). 

The  reference  rotation  and  translation  parameters: 

0o  =  78,  nOl  =  0.615661475,  n02  =  0.258819045,  n03  =  0.74429406, 

Axo  =  23,  Ayo  =  -10,  Azo  =  1 

The  object  coordinates  (xi1,  yi ' ,  zi'),  and  image  coordinates  (Xi1,  Yi') 
at  t2  were  then  computed  accordingly  using  (1)  and  (3).  The  following  two 
solutions  were  found: 

Solution  1:  the  same  as  the  reference  solution. 

Solution  2:  0  =  159.722148,  nl  =  0.087422567,  n2  =  0.36295928 

n3  =  -0.9276949,  Ax  =  5.97327196,  Ay  =  1.50137639. 


[Example  2]  Six  point  case. 
The  object  coordinates  at  tl: 
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(xl,  yl,  zl)  =  (3,  15.7,  54.908),  (x2,  y2,  z2)  =  (28.1,  15,  166.111) 
(x3 ,  y3 ,  z3)  =  (5,  12.9,  42.232),  (x4,  y4 ,  z4)  =  (32.7,  24.7,  309.716) 
(x5 ,  y5,  z5)  =  (13.1,  31,  249.971),  (x6,  y6,  z6)  =  (15,  9.7,  55.868) 

The  image  coordinates  at  tl: 

(XI,  Yl)  =  (0.0546368,  0.285933),  (X2,  Y2)  =  (0.169164,  0.0903011) 

(X3 ,  Y3)  =  (0.1183936,  0.3054556),  (X4,  Y4)  =  (0.1055806,  0.0797505) 
(X5 ,  Y5 )  =  (0.0524061,  0.1240144),  (X6,  Y6)  =  (0.26849,  0.1736235) 

The  reference  motion  parameters: 

0o  =  78,  nol  =  0.615661475,  no2  =  0.258819045,  no3  =  0.74429406, 

Axo  =  23,  Ayo  =  -10,  Azo  =1. 

(xi',  yi',  zi')  and  (Xi',  Yi')  were  then  computed  using  (1)  and  (3)  with 
the  above  reference  motion  parameters.  The  following  two  solutions  were 
found : 

Solution  1:  Same  as  the  reference  solution. 

Solution  2:  0  =  47.65578,  nl  =  0.6304461986,  n2  =  0.06582693435, 

n3  =  0.7735214391,  Ax  =  -3.683375707,  Ay  =  0.6458049137. 
For  each  of  the  two  solutions  in  the  above  two  examples,  the  z  coordinates 
for  each  point  using  (5a)  and  (5b)  were  all  positive. 
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VII.  CONCLUSIONS 

Several  theorems  and  corollaries  have  been  stated  and  proved  regarding 
the  uniqueness  and  estimation  of  3— D  motion  parameters  of  rigid  bodies.  In 
summary,  the  following  results  have  been  established: 

(1)  The  fact  that  we  can  define  8  essential  parameters  e 1 ,e2, . . . ,e8 , 
that  contain  all  the  information  one  can  possibly  obtain  given 
any  number  of  image  correspondences ,  and  are  unique  given  the 
image  correspondences  of  at.  least  seven  points  not  lying  on  two 
planes  with  one  plane  passing  through  the  origin,  nor  on  a  cone 
containing  the  origin. 

(2)  The  fact  that  given  the  E  matrix  consisting  of  the  eight  essential 
parameters,  the  actual  motion  parameters  are  unique,  and  can  be 
computed  simply  by  taking  the  singular  value  decomposition (SVD ) 

of  the  3x3  E  matrix. 

(3)  A  method  of  determining  the  E  matrix  given  8  image  correspondences. 

This  requires  the  solution  of  a  set  of  linear  equations  only. 

(M)  An  operational  criteria  for  the  uniqueness  of  motion  parameters. 

If  the  determinant  of  a  certain  8x8  matrix  containing  only  the 
image  coordinates  of  eight  image  correspondences  does  not  vanish, 
the  uniqueness  is  assured. 


The  results  in  this  paper  should  be  of  interest  to  numerous 


areas  of  research,  including  image  sequence  analysis,  tracking,  image 
coding,  stereo  imaging,  photogramme try,  and  robotic  vision. 
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